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At  levels  above  the  boundary  layer  (1.  5km  to  20km),  the  equations  for  wind, 
temperature,  and  humidity  are  fairly  easy  to  solve,  as  the  nonconservative  term 
is  either  vanishingly  small  or  can  be  expressed  in  terms  of  other  variables.  How¬ 
ever,  aviation  terminals  are  located  at  the  bottom  of  the  boundary  layer,  where  the 
nonconservative  terms  can  be  very  important.  These  terms  include  surface  fluxes 
of  momentum,  heat,  and  water  vapor.  In  addition,  over  a  period  of  a  few  hours, 
the  hydrometeors  that  make  up  clouds,  precipitation,  and  visibility  restrictions 
are  constantly  settling  out  and  being  replaced  through  nonconservative  processes. 
Thus,  the  physics  of  short-range  forecasting  of  surface  weather  conditions  is 
quite  complex,  and  forecasting  is  a  very  difficult  task. 

One  approach  to  the  problem  is  to  assume  that  the  nonconservative  term  is 
related  to  atmospheric  dynamics  that  are  propagating  systematically,  as  if  advec- 
ted.  For  example,  the  clouds  may  be  formed  by  vertical  motions  related  to  moving 
synoptic-scale  patterns,  and  the  visibility  reduction  may  be  related  to  a  moving 
pattern  of  precipitation  falling  into  the  boundary  layer.  Thus,  we  can  write 

20.  =  -v**FQ  (2) 

at 

where  V*  is  the  wind  field  advecting  the  weather  patterns. 

This  equation  can  be  easily  solved  (graphically  or  by  computer)  to  produce 
local  forecasts  with  high  temporal  resolution  once  V*  is  known.  The  forecast 
procedure  is  to  simply  step  upstream  at,  say,  hourly  intervals,  with  distances 
proportional  to  speed,  and,  at  each  point,  extract  the  corresponding  value  of  Q, 
which  is  advected  downstream  to  become  the  forecast.  The  technique  can  take 
full  advantage  of  the  airways  observations,  which  have  a  spacing  of  about  60- 120  km 

in  the  eastern  United  States,  thus  resolving  disturbances  with  equivalent  wave 

* 

lengths  of  about  300km.  By  contrast,  the  Limited  Area  Fine  Mesh  (LFM)  model 

uses  data  with  300-400 km  spacing  and  analyzes  disturbances  down  to  about  1000- 

km  wavelength  (though  somewhat  smaller  scales  may  be  generated  ih  forecasts). 

To  make  a  forecast,  one  does  need  the  field  of  V  .  One  way  to  determine 

this  vector  is  to  use  two  (or  more)  recent  charts  of  Q,  separated  in  time,  and 

determine  the  motion  vector  which  best  explains  the  changes  in  the  patterns, 
o 

Muench  noted  that  this  approach  can  objectively  produce  forecasts  of  cloud 


J,'c 

The  LFM  is  the  current  operational  prediction  model  of  the  National  Weather 
Service  used  for  local  forecasts. 

2.  Muench,  H.  S.  (1983)  Short-Range  Forecasting  of  C  loudiness  and  Precipitation 

ttion  of  GOES  Imagery,  AFGL-TR-81-0218,  ADA108678. 


amount  and  precipitation  probability  better  than  persistence  for  periods  of  2-7 
hours  (Using  satellite  imagery).  In  addition,  forecasts  using  the  700-mb  wind 
instead  of  the  motion  vector  based  on  recent  change  in  pattern  were  very  nearly 
as  accurate  and,  of  course,  simpler  to  obtain.  This  latter  result  was  not  sur¬ 
prising;  forecasters  for  the  past  30  years  or  more  have  used  700-mb  (3  km)  winds 
to  predict  motion  of  precipitation  patterns  as  one  of  many  subjective  "rules  of 
thumb. " 

The  advection  technique  has  the  potential  for  providing  useful  short-range 
forecasts  without  a  formal  solution  of  the  dynamic  equations  in  a  mesoscale 
environment.  To  evaluate  this  potential,  we  made  a  series  of  developments  and 
tests  with  successively  increasing  complexity.  First  was  a  rather  sirrple  test 
(Experiment  1)  that  uncovered  some  basic  problems.  Then,  in  Experiments  II 
and  I1IA,  we  made  and  tested  modifications  to  the  advection  technique  that  compen¬ 
sated  for  stationary  patterns  and  diurnal  changes.  With  Experiments  IIIB  and 
IUC,  we  made  improvements  by  including  editing  and  pre-processing  of  data 

(IIIB)  and  by  introducing  higher-resolution  objective  inalyses  (1IIC).  This  report 

2234 

will  first  review  results  of  experiments  I,  II,  and  HIA  (previously  published1*  '  *  q) 
and  then  describe  the  developments  ana  testing  for  Experiments  IIIB  and  IIIC, 
Finally,  a  discussion  of  inherent  difficulties  in  short-range  forecasting  and 
suggestions  for  future  research  are  included. 


2.  REVIEW  OF  EXPERIMENTS  1.  II.  AMI)  IIIA 

The  first  step  was  to  conduct  Experiment  I,  a  forecast  experiment  using 
upper  level  winds  to  make  short-range  forecasts  of  surface  weather  parameters 
using  the  concept  of  simple  advection.  For  this  test,  and  for  subsequent  tests, 
forecast  errors  were  evaluated  by  comparison  of  root -mean-square  (rms)  errors 
with  errors  for  persistence  (no  change  with  time  from  current  conditions).  In 
addition,  forecasts  were  also  compared  with  the  operational  model-output-stati- 
sties  (MOS)  forecasts,  based  on  the  local  observation,  and  also  forecast  para¬ 
meters  from  the  LFM.  Forecasts  were  made  for  cloud  amount;  surface  wind. 


3.  Muench,  H.S.  (1983)  Experiments  in  Objective  Weather  Forecasting  Using 

Upper-Level  Steering,  AFGL-TEi-83-0328,  Ab  A143393. 

4.  Muench,  H.S.  (1984)  Objective  short-range  weather  forecasts  experiments 

using  meso-scale  analyses  and  upper-level  steering.  Preprints.  lOthConfp- 
rence  on  Weather  Forecasting  and  Analysis,  Am.  Meteorol.  Soc.  pp.  241-248. 

5.  Glahn,  H.R.,  and  Lowry,  D,  (1972)  The  use  of  model  output  statistics  (MOS) 

in  objective  weather  forecasting,  J.  Appl.  Meteorol.  11:1203-121  1. 
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visibility,  and  dewpoint  for  time  periods  of  0-15  hours,  using  the  AFGL  McIDAS 
(interactive  computer  system)  minicomputer  and  display  together  with  software 
written  by  the  University  of  Wisconsin. 

The  net  results  of  the  forecast  test  for  the  single  advection  model  were  rather 
disappointing. 1  The  forecasts  for  most  of  the  parameters  and  most  of  the  time 
periods  were  worse  than  persistence.  Even  when  better  than  persistence,  the 
advection  forecasts  were  worse  than  the  MOS  forecasts.  At  this  point,  the  follow¬ 
ing  sources  of  potential  errors  and  possible  solutions  were  examined: 

A.  The  analyzed  field  of  ©  contains  both  stationary  and  moving  disturbances, 
and  serious  errors  result  when  the  quasi- stationary  patterns  are  advected. 

B.  The  nonconservative  term  contains  effects  of  the  diurnal  heating  and 
cooling  of  the  boundary  layer.  This  has  the  effect  of  a  disturbance  moving  west¬ 
ward  at  15  degrees  of  longitude  an  hour,  totally  unrelated  to  the  700 -mb  flow. 

Diurnal  boundary  layer  changes  have  the  greatest  effect  on  temperature,  but  visi¬ 
bility,  ceiling  and  wind  speed  are  also  affected. 

C.  Because  of  McIDAS  computer  limitations,  the  weather  parameter  analyses 

used  in  the  forecast  were  done  on  a  1 -degree  latitude-longitude  grid  with  a  single 

6  7 

pass  Cressman-type  routine,  which  tends  to  oversmooth  in  data-rich  areas. 

Some  small  disturbances  were  probably  lost  in  the  objective  analysis  and  not 

forecast. 

D.  A  single  advection  flow  based  on  analyzed  wind  fields  may  not  be  best  for 
all  parameters  In  particular,  flows  nearer  the  surface  might  be  better  for  visi¬ 
bility  and  dewpoint.  Unfortunately,  the  low-level  flows  can  change  rapidly  with 
time,  particularly  with  passage  of  cyclones  and  anticyclones. 

In  all  likelihood,  factors  A  through  D  contributed  to  the  poor  performance  of 
the  simple  advection  technique.  Thus,  we  made  an  increasingly  complex  series 
of  technique  modifications.  With  each  modification,  a  specific  factor  was  addressed, 
the  forecast  procedure  was  changed,  and  a  forecast  experiment  conducted. 

The  first  problem  to  be  considered  was  the  effects  of  stationary  patterns, 
related  to  orography.  If  the  stationary  patterns  are  advected,  forecast  errors 
will  result.  One  solution  is  to  forecast  observed  changes  in  ©  rather  than  the 
value  itself.  The  changes  are  advected  and  then  added  to  the  initial  condition  to 
produce  a  forecast,  a  procedure  we  call  "change -advection. " 


6.  Cressman,  G.  P.  (1959)  An  operational  objective  analysis  system,  Mon.  Wea. 

Rev.  87:367-371. 

7.  Gerlach,  A.  M.  (ed.  H1982)  Objective  Analysis  and  Prediction  Techniques. 

AFGL-TR -0394,  ADA131465,  Contract  F  19628-82-C-0023,  Systems  and 
Applied  Sciences  Corp.  (SASC),  pp.  65-73. 


Change-advection  was  tested  in  Experiment  II.  For  12  active  weather  cases 
during  the  winter  of  1982-83,  the  change-advection  technique  produced  forecasts 
better  than  both  persistence  and  simple  advection  out  to  3  hours,  for  wind,  cloud 

3 

amount,  and  temperature.  However,  the  forecast  scores  deteriorated  rapidly 
beyond  4  hours.  In  the  case  of  temperature  (and,  to  a  lesser  extent,  wind),  the 
change-advection  technique  advected  both  the  diurnal  changes  and  non-diurnal 
changes  observed  between  1200  and  1500 UT  and  between  0000  and  0300 UT,  and 
continued  the  trends  out  to  15  hours.  When  the  diurnal  curves  flattened  and  re¬ 
versed  direction  (usually  at  about  2100  UT  and  1100UT),  large  errors  were 
incurred  by  the  change-advection  technique. 

If  the  contribution  of  the  diurnal  cycle  can  be  specified,  it  is  possible  to  re¬ 
move  the  effect  from  the  initial  data,  proceed  with  the  simple  advection  (or  change 
advection),  and  then  add  back  the  diurnal  component  for  the  forecast  time.  A 
"diurnal  modification"  routine  was  developed  based  on  this  idea  and  was  tested  on 
a  series  of  12  cases  in  March  1983  (nominally  selected  at  36-hour  intervals).  In 
this  experiment.  Experiment  IILA,  forecasts  were  with  simple  advection  and 
change-advection,  both  with  and  without  the  diurnal  modification.  The  forecasts 
with  the  diurnal  modification  markedly  improved  the  forecasts  of  temperature  and 
visibility.  Visibility  was  better  than  both  MOS  and  persistence  at  3-9  hours. 

While  different  versions  of  the  advection  forecast  techniques  were  tested, 
upper-level  flows  other  than  the  700-mb  wind  were  also  tested.  First,  a  verti¬ 
cally  integrated  850-300  mb  flow  proved  to  be  slightly  worse  than  just  the  700  mb 
flow.  However,  a  spatially  averaged  and  vertically  integrated  700-500-mb  flow 
produced  forecasts  with  errors  up  to  20  percent  smaller  than  the  700-mb  flow, 
particularly  for  visibility,  temperature,  and  dewpoint.  The  space-average  was 
introduced  when  we  found  that  the  700-mb  flow  was  not  properly  predicting  the 
eastward  motion  of  major  frontal  systems. 

An  overall  result  of  these  enhancements  to  the  advection  technique  is  that 
each  step  seems  to  add  a  small  improvement  to  the  skill  scores.  Since  there 
were  still  more  steps  to  be  taken,  we  were  optimistic  that  routine  forecasts  based 
on  advection  might  prove  to  be  better  than  both  persistence  and  MOS  for  1-9  hours, 
for  many  weather  elements.  Thus,  the  project  continued,  first  developing  data 
editing  and  adjustment  procedures  and  then  introducing  higher  resolution  objective 
analysis. 


:t.  FDITIX;  AM)  ADJUSTING  INITIAL  DATA 

The  procedure  for  archiving  the  hourly  observations  using  the  AFGL  McIDAS 
consists  of  identifying  messages  received  on  the  FA  A  604  communication  line. 
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decoding  the  messages,  packing  data  on  disk,  and  periodically  dumping  to  magnetic 
tape.  At  no  point  in  the  process  is  any  editing  performed;  all  data  are  accepted  at 
face  value. 

Errors  may  creep  into  the  process  at  any  stage  from  the  initial  observation 
to  the  final  archive  (and  subsequent  recovery).  Even  though  observers  often 
detect  their  own  errors  and  then  transmit  corrected  reports,  the  McIDAS  software 
currently  is  not  capable  of  interpreting  the  corrections  unless  a  complete  observa¬ 
tion  including  the  corrected  variable  is  transmitted.  The  occasional  "noise"  on 
the  communication  line  is  an  additional  source  of  error.  The  initial  verification 
of  the  March  1983  forecasts  of  persistence  showed  a  few  "spikes"  in  otherwise 
smooth  curves  of  error- versus -time  plots,  and  further  probing  revealed  that  some 
serious  errors  were  present  in  the  verification  reports,  about  one  error  for  every 
600  correct  values.  The  objective  analyses  use  about  400  reports  for  each  vari¬ 
able,  so  it  was  likely  that  some  analyses  contained  contamination  from  errors. 

Such  contamination  would  lead  to  forecast  errors  if  the  data  errors  were  upstream 
from  a  forecast  site.  Fortunately,  the  errors  were  infrequent  and  were  to  some 
extent  reduced  by  the  smoothing  in  the  analysis  procedure.  However,  it  would  be 
preferable  to  remove  the  most  obvious  errors  before  the  analysis,  forecasting, 
and  verification  take  place. 

An  inspection  by  eye  of  the  many  thousands  of  numbers  that  go  into  a  forecast 
experiment  would  be  extremely  tedious,  and  for  such  a  task,  computer  assistance 
is  desirable.  The  simplest  way  to  detect  meteorological  errors  is  to  examine 
either  a  time  series  or  a  spatial  distribution  of  a  particular  variable;  large  errors 
appear  as  conspicuous  maxima  or  minima.  Since  the  observations  are  usually 
regularly  spaced  in  time  (hourly)  but  not  in  space,  it  is  easier  to  set  up  a  compu¬ 
ter  procedure  if  time  series  are  used.  Numerically,  the  sharp  maxima  and  min¬ 
ima,  when  computed  from  finite  differences,  result  in  large  absolute  values  of  the 
second  derivative.  With  three  consecutive  values,  Qj,  Q2,  and  Qg,  the  second 
derivative  j  -  Og  -  2Q2>  |  is  confuted  and  compared  to  some  threshold,  and 
action  is  taken  when  the  threshold  is  exceeded. 

A  procedure  to  detect  large  errors  in  the  March  1983  data  set  was  developed, 
using  a  computer  to  scan,  station  by  station,  in  an  interactive  mode.  This  allows 
the  forecaster  to  decide  whether  to  accept  a  suspicious  value,  insert  a  temporal 
interpolation,  or  insert  a  missing  value.  The  thresholds  used  were  23  m/s  (45 
knots)  for  the  vector  wind  and  20  C'  for  temperature  and  dewpoint.  No  inspection 
was  made  for  cloud  cover  and  visibility  errors,  as  their  natural  variability  is 
great  enough  to  cause  difficulties  with  so  simple  a  routine. 

Besides  the  data  errors,  incompatibilities  exist  between  observations  that  can 
cause  problems  for  advection  forecasts.  For  example,  in  the  experiments  using 
the  March  1983  data  base,  the  skill  scores  for  wind  speed  were  much  lower  than 
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the  scores  for  the  vector  wind.  In  effect,  wind  direction  was  better  forecast  than 
wind  speed.  Part  of  the  problem  is  that  anemometers  are  located  at  different 
heights  above  ground,  and  the  terrain  varies  in  roughness  from  site  to  site,  so 
that  different  wind  speeds  could  well  be  reported  from  stations  with  basically  the 

g 

same  boundary  layer  wind. 

We  set  up  a  simple  normalization  procedure  to  reduce  the  local  effects  on 
wind  speed.  First,  the  average  midday  wind  speed  for  March  1983  was  computed 
for  all  stations  from  30N  to  50N  and  65W  to  95W.  Then  the  average  850-mb  wind 
speed  was  computed  for  the  same  area,  using  both  0000  UT  and  1200  UT  soundings. 
The  overall  pattern  for  mean  wind  speed  for  surface  and  850  mb  were  quite  similar, 
though  the  surface  winds  had  about  half  the  speed.  A  "representative"  mean  sur¬ 
face  wind  speed  was  thus  assumed  to  be  0.  50  times  the  monthly  mean  850-mb 
wind  speed  at  that  site.  If  S  is  the  mean  surface  wind  speed  and  Sg  the  mean 
850-mb  wind  speed,  a  normalization  factor  Cg  was  defined  by  the  relation 


Cg  a  0.50 


(3) 


and  computed  for  each  station.  In  general,  major  airport  sites  were  found  to  have 
factors  of  about  0.8.  Military  airports  with  anemometer  height  of  13  feet  rather 
than  FAA  standard  of  20  feet  had  factors  of  about  1.2.  Stations  in  hilly  or  wooded 
terrain  also  had  factors  of  about  1.2.  Some  earlier  computations  of  Cg  (unpub¬ 
lished)  had  been  made,  based  first  on  climatological  data  and  then  on  special  cases 
with  homogeneous  wind  flow,  and  the  values  found  were  quite  close  to  those  found 
here.  For  the  March  1983  data  base,  the  arithmetic  mean  factor  of  all  stations 
was  1. 08,  implying  that  a  value  of  0.  46  would  have  been  more  appropriate  in 
computing  Cg  rather  than  the  0.  50  that  was  actually  used.  The  standard  deviation 
of  Cg  was  *  0.2  3,  indicating  that  more  than  one  third  of  the  stations  require  an 
adjustment  of  20  percent  or  more  to  the  wind  speed.  To  use  this  wind  speed 
normalization,  one  simply  multiplies  each  observed  wind  speed  by  Cg,  makes  an 
advection  forecast,  and  then  divides  by  ('  for  the  forecast  site.  This  is,  of 
course,  an  overall  adjustment  factor,  and  includes  effects  of  anemometer  height, 
micrometeorological  terrain  effects,  and  systematic  effects  such  as  elevation 
above  sea  level. 

Observations  of  temperature  and  dewpoint  also  suffer  from  local  effects, 
particularly  resulting  from  station  elevation.  In  principle,  the  change-advection 
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technique  can  bypass  this  problem,  but,  unfortunately,  the  technique  has  not 
proved  effective  beyond  3  hours.  To  aid  the  regular  advection  forecasts,  proce¬ 
dures  were  developed  to  make  local  adjustments  to  the  temperatures  and  dewpoints. 
As  with  the  wind  speed,  a  representative  monthly  mean  temperature  was  presumed 
to  be  directly  related  to  the  monthly  mean  850-mb  temperature.  In  developing 
algorithms  for  the  diurnal  temperature  cycle,  we  found  1000  local  sun-time  temp¬ 
erature  close  to  the  24-hour  average.  Thus,  1000  local  sun-time  temperatures 
were  computed  at  each  station  (T)  for  comparison  to  the  mean  850-mb  temperature 
(Tg).  Looking  at  stations  within  300  meters  of  sea-level,  the  temperature  pattern 
closely  followed  that  of  850  mb,  but  with  more  north-south  amplitude,  implying 
greater  static  stability  to  the  north.  A  good  estimate  of  the  sea-level  monthly 
mean  temperature  T£  was  found  to  be 

TE  =  Tg  +  3.9  +  5.  OjTanh  [(44  -  Lat.)/9}}.  (4) 

Local  adjustments  to  the  temperature  were  computed  for  each  station  by  sub¬ 
tracting  the  observed  mean  temperature  T  from  T£.  The  mean  adjustment  for 
all  stations  was  found  to  be  +1.  58  C  with  a  standard  deviation  of  ±2.  08  C.  As  with 
the  wind  factor,  the  temperature  adjustments  are  to  be  added  to  the  observations 
before  the  analyses  and  advection  forecasts  made,  and  later  substracted  from  the 
forecasts,  before  verification. 

When  the  monthly  mean  dewpoints  (H)  were  compared  to  the  850-mb  monthly 
mean  dewpoints  (Hg),  the  patterns  in  the  eastern  United  States  appeared  to  be 
poorly  related,  and  the  850-mb  dewpoint  did  not  look  suitable  to  compute  a  repre¬ 
sentative  value.  Instead,  it  was  noted  that  the  pattern  of  surface  dewpoint  was 
similar  to  the  near-sea-level  temperature  pattern  but  with  less  amplitude,  indi¬ 
cating  the  dewpoint  spread  was  largest  where  temperatures  were  highest,  with 
about  a  linear  decrease  towards  lower  temperatures  (for  30N  to  50N).  Thus  a 
representative  dewpoint  HE  was  found  to  be 

HE  =  .75  TE  -  1.36.  (5) 

As  with  temperature,  local  adjustment  factors  for  the  dewpoint  were  computed  for 
each  station  by  subtracting  the  monthly  mean  dewpoints  H  from  the  calculated 
values  of  HE.  For  all  stations  combined,  the  mean  adjustment  was  -1. 48  C, 
suggesting  that  a  smaller  constant  value  might  be  more  reasonable  in  computing 
He.  The  standard  deviation  of  the  adjustment  was  ±2.48C,  actually  a  little 
larger  than  for  temperature. 

Undoubtedly,  modification  procedures  should  also  be  developed  for  other 


parameters  such  as  cloud  amount,  ceiling,  and  visibility.  Unfortunately,  these 
parameters  are  difficult  to  work  with  because  their  frequencies  are  far  from 
"normal.  "  Furthermore,  no  obvious  way  exists  to  easily  specify  representative 
climatological  estimates  for  comparison  with  observed  data  to  develop  local 
adjustments.  With  ceiling  and  visibility,  many  years  of  data  for  a  given  month 
would  be  necessary  to  obtain  valid  adjustments  for  the  infrequent  but  operationally 
important  low  values.  We  left  this  for  later  study. 

In  Experiment  IIIA,  when  the  diurnal  modification  was  introduced,  a  2-hour 
time  average  of  the  analyzed  surface  wind  components  was  performed  before  the 
forecasts,  using  McIDAS  software.  We  felt  this  time  average  was  necessary 
since  the  nominal  1-  to  2-min  average  winds  in  the  observations  contain  consid¬ 
erable  high  frequency  noise  that  should  be  removed  before  making  forecasts.  For 
this  next  experiment,  we  introduced  a  running-time  average  as  an  alternative. 

For  example,  when  Uj  is  the  current  u-component  and  Ug  is  the  previous  running 
mean,  then  the  current  running  mean  Uj  is  computed  by 

Uj  =  oiUj  +  (1  -  a)  Ug  (6) 

where,  based  on  a  few  experiments,  a  value  of  0.  55  was  determined  for  a.  In 
practice,  running-time  averages  of  each  component  would  be  computed  and  time- 
averaged  direction  and  speed  derived. 

Up  to  this  point,  procedures  were  developed  to  adjust  wind  speed,  temperature 
and  dewpoint  for  local  effects,  to  edit  observations  of  wind,  temperature,  and  dew¬ 
point,  and  also  to  use  a  running-time  average  for  wind.  In  order  to  run  an  experi¬ 
ment  that  could  be  compared  with  the  previous  experiments.  Experiment  Ilia, 
archived  data  for  March  1983  were  edited,  adjusted,  time-averaged,  and  then 
repacked  in  the  original  form  so  that  objective  analysis  could  be  made  using  the 
same  McIDAS  software. 

Previous  experiments  had  indicated  a  definite  advantage  in  using  space-aver¬ 
aged  winds  for  advection  rather  than  just  the  700-mb  winds  (though  not  necessarily 
for  all  parameters).  The  850-mb  wind  had  been  considered  as  a  potentially  useful 
advection  flow,  particularly  for  temperature,  dewpoint,  and  visibility.  However, 
we  were  concerned  that  the  flow  might  change  too  rapidly  with  time  to  make  valid 
forecasts  for  more  than  a  few  hours.  To  allow  for  such  changes,  a  procedure  was 
developed  to  use  the  space-averaged  500-mb  wind  to  advect  the  850-mb  wind  and 
then  use  the  advected  850-mb  wind  to  advect  the  surface  weather  parameters--a 
"double-advection"  technique. 

The  last  step  before  performing  a  new  forecast  experiment  with  all  of  the  new 
enhancements  was  to  make  the  appropriate  modifications  to  the  computer  programs 
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The  forecast  software  was  set  up  to  test  four  different  advection  flows.  First, 
a  sinple  700-mb  advection  flow  was  included  in  order  to  compare  results  with 
previous  experiments.  Next,  a  space -averaged  500-mb  flow  was  constructed  by 
averaging  16  degrees  in  longitude  and  12  degrees  in  latitude.  This  space-aver- 
aged  flow  was  used  as  the  second  advection  flow  and  also  served  as  the  first 
step  in  the  double-advection  procedures.  The  third  advection  flow  was  a  double- 
advection  procedure  where  the  space-averaged  flow  advected  the  700-mb  flow, 
which  then  advected  the  weather  parameters.  The  last  advection  flow  was  also 
double-advection,  but  using  850-mb  instead  of  700-mb  flow. 

The  results  of  this  new  forecast  experiment  (Experiment  IIIB)  are  shown  in 
the  form  of  tables  of  skill  scores  and  rms  errors  in  the  Appendix.  In  addition, 
plotted  values  of  skill  score  (relative  to  persistence)  vs  time  are  shown  for  six 
parameters  in  Figures  1-6.  In  these  figures,  two  curves  represent  skill  scores 
(relative  to  persistence)  for  simple  700-mb  advection  for  Experiments  IIIA  and 
IIIB.  A  comparison  of  the  two  curves  provides  a  basis  for  judging  the  effects  of 
adjusting  the  input  data.  In  Experiment  IIIA,  we  noted  that,  for  a  given  para¬ 
meter,  no  single  advection  technique  was  superior  at  all  time  intervals.  A  fore¬ 
caster  would  do  best  using  different  techniques  for  different  intervals.  Thus, 
these  figures  also  show  a  "best-combination"  curve,  based  on  the  best  two  or 
three  advection  techniques.  The  composition  of  each  combination  will  be  noted 
in  the  following  paragraphs.  These  best-combination  scores  indicate  potential 
forecast  value  for  advection  techniques  when  the  magnitudes  are  greater  than 
zero,  and,  of  course,  should  be  compared  to  the  MOS  scores  that  are  also  shown 
in  the  figures. 

While  we  did  not  edit  the  cloud  data  and  adjustment  for  local  effects,  we  made 
a  small  modification  to  the  program  to  prohibit  forecasts  of  negative  cloud  amounts 
or  greater  than  overcast.  This  did  result  in  the  small  improvements  that  can  be 
seen  (Figure  1)  for  the  700-mb  advection  scores  of  Experiment  IIIB  over  IIIA. 

The  best  combination  consisted  of  change -advection  for  the  first  2  hours  and 
advection  with  diurnal  modifications  for  3  to  15  hours,  all  using  the  500-mb 
space-averaged  winds  (double  advection  forecasts  were  not  as  good).  This  best 
combination  is  better  than  MOS  and  persistence  at  3  hours,  and  slightly  worse 
than  MOS  at  the  next  point  at  9  hours.  The  crossover  point  is  about  7  hours. 

These  results  are  certainly  encouraging,  especially  since  there  are  prospects  of 
doing  even  better  when  satellite  data  can  be  included. 

♦Following  the  graphical  500  mb  forecast  techniques  of  1950s,  80  percent  of  the 
space -averaged  flow  was  used.  The  80-percent  factor  is  believed  to  be 
necessary  because  the  "level  of  nondivergence"  is  near  600  mb  rather  than 
500  mb. 
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Figure  1.  Forecast  Skill  Scores  (Relative  to  Persistence)  for  Experiments  MA  and  IIIB:  Cloud  Cover 


Figure  2.  Forecast  Skill  Scores  (Relative  to  Persistence)  for  Experiments  IILA  and  IIIB:  Vector  Wind 


Figure  3.  Forecast  Skill  Scores  (Relative  to  Persistence)  for  Experiments  MA  and  RIB:  Wind  Speed 
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Figure  4.  Forecast  Skill  Scores  (Relative  to  Persistence)  for  Experiments  HIA  and  RIB:  Visibility 
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Figure  5.  Forecast  Skill  Scores  (Relative  to  Persistence)  for  Experiments  MA  and  HIB:  Temperature 


Figure  6.  Forecast  Skill  Scores  (Relative  to  Persistence)  for  Experiments  IIIA  and  DIB:  Dew  Point 


Figure  2  shows  that  the  adjustments  to  the  wind  data  did  produce  small  but 
consistent  improvements  to  the  700-mb  advection  forecasts  of  the  vector  wind, 
at  least  at  3  hours  and  more.  Though  there  may  be  a  decrease  in  skill  at  1  to  2 
hours,  perhaps  due  to  the  time  averaging,  the  change-advection  scores  for  these 
times  did  improve,  resulting  in  the  small  positive  scores  as  part  of  the  best 
combination.  Like  the  cloud  amount,  the  best  combination  consisted  of  the  change- 
advection  for  the  first  2  hours,  and  then  the  advection  with  diurnal  modification 
for  the  3  to  15-hour  forecasts,  all  using  the  500-mb  space -averaged  winds.  And, 
like  the  cloud  amount  skill  scores,  the  best  combination  is  better  than  MOS  at  3 
hours  and  slightly  worse  at  9  hours,  with  a  crossover  near  7  hours. 

Looking  at  Figure  3,  we  note  that  there  were  improvements  in  the  skill  scores 
for  wind  speed,  but  only  after  7  hours  are  the  scores  better  than  persistence.  As 
might  be  expected,  the  best  combination  for  wind  speed  was  the  same  combination 
as  for  the  vector  wind.  The  best  combination  scores  are  slightly  worse  than  the 
MOS  scores  at  3,  9,  and  15  hours,  so  more  work  must  be  done.  The  best  hopes 
for  improvement  are  for  a  better  diurnal  adjustment  (the  routine  used  was  not 
suitable  for  the  frequent  cloudy  conditions  in  this  experiment)  and  perhaps  a  better 
time -averaging.  We  should  note  that,  for  periods  out  to  6  hours,  the  rms  change 
in  wind  speed  was  less  than  ±  2  m/s  (4  knots,  indicating  that  large  changes, 
which  might  be  caused  by  travelling  disturbances,  were  relatively  rare  even 
during  the  month  of  March. 

In  Figure  4,  the  curves  for  the  visibility  forecast  scores  fall  very  nearly  on 
top  of  one  another.  There  was  no  editing  of  the  visibility  reports  and  no  correc¬ 
tion  applied  for  local  effects,  so  one  would  expect  the  scores  for  the  700-mb 
advection  forecasts  of  Experiments  IIIA  and  IIIB  to  be  identical.  The  best-com¬ 
bination  forecast  is  based  on  a  700-mb  change-advection  for  1-2  hours,  500-mb 
advection  with  diurnal  modification  for  3-10  hours,  and  500-mb  advection  for 
11-15  hours.  The  skill  scores  are  better  than  those  of  MOS  at  3  and  9  hours, 
though  not  15  hours.  The  crossover  point  is  near  10  hours. 

Surprisingly,  the  efforts  to  adjust  the  temperatures  for  local  effects  (inclu¬ 
ding  station  altitude)  did  not  produce  any  overall  improvements  in  the  skill  scores, 
as  seen  by  comparing  the  700-mb  curves  in  Figure  5.  The  double-advection 
concept  appears  to  be  a  step  in  the  right  direction,  as  the  best  combination  was 
500  -*  850-mb  change  advection  for  1-3  hours,  500  -»  700-mb  change-advection 
with  diurnal  modification  for  4-8  hours,  and  500  -  850-mb  advection  with  diurnal 
modification  for  9-15  hours.  The  skill  scores  are  still  only  comparable  with  those 
of  MOS  out  to  3  hours,  and  considerably  worse  beyond.  A  closer  examination 
revealed  that  the  forecast  scores  for  Washington,  D.  C. ,  which  is  often  downwind 
of  higher  elevation  stations  in  West  Virginia,  did  improve,  but  for  stations  east 
of  the  Great  Lakes,  the  scores  were  worse.  This  result  suggests  some  regional 


problems  with  the  adjustment  procedure,  with  the  introduction  of  satellite  data, 
the  forecasts  may  be  improved  by  using  a  cloud  density  factor  to  better  account  for 
the  diurnal  trends. 

In  Figure  6,  comparing  curves  IIIA  and  IIIB,  it  is  quite  apparent  that  the 
editing  and  data  adjustment  did  improve  the  dewpoint  forecasts,  with  the  700-mb 
advection  scores  up  to  0. 2  better  than  the  previous  experiment.  Here  the  best 
combination  was  change -advection  at  1  hour,  500  -»  850-mb  advection  for  2-5 
hours,  and  566-mb  advection  for  6-15  hours.  Though  the  scores  are  now  better 
than  persistence  for  3-15  hours,  only  at  3  hours  are  they  better  than  those  of  MOS. 

Overall,  the  results  of  Experiment  IIIB  using  adjusted  input  data  continued  the 
trend  from  previous  experiments  showing  small  but  useful  increases  in  the  skill 
scores.  With  the  best  combination  of  techniques,  typically  change-advection  for 
the  first  few  hours  and  simple  advection  for  the  longer  periods,  the  skill  scores 
have  risen  to  the  point  that  they  are  often  better  than  both  persistence  and  MOS 
out  to  about  6  hours.  And  some  enhancements  not  yet  tried  could  produce  further 
improvement  in  the  scores.  In  particular,  we  now  proceed  to  an  experiment  using 
higher-resolution  objective  analyses. 

4.  HIGHER -RESOLUTION  OBJECTIVE  ANALYSES 

At  several  points  during  the  development  of  the  advection  technique,  we  were 
concerned  that  the  objective  analyses  constructed  by  the  McIDAS  routines  did  not 
portray  all  the  information  available  in  the  hourly  reports,  and  that  a  more  sophi¬ 
sticated  analysis  technique  should  be  tried. 

The  conventional  surface  objective-analysis  scheme  in  the  AFGL  McIDAS 
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system  is  a  simple,  single-pass,  nearest -neighbors  approach.  It  determines  the 
gridpoint  values  by  computing  a  weighted  average  of  the  eight  observation  values 
closest  to  each  gridpoint  while  using  a  Cressman-tvpe  distance -weight  function. 

g 

The  Cressman  weight  function  (wn>  has  the  form 


wn  -  (R* 


d  2> / (R2  +  d  2) 
n  n 


where  dR  is  the  distance  between  the  observation  n  and  the  analysis  gridpoint. 

R  is  the  so-called  scan  radius  which  defines  the  distance  from  the  gridpoint  at 
which  wR  has  a  value  of  0.  0.  In  this  application,  R  is  defined  as  the  distance  to 
the  ninth  closest  observation  site  from  each  gridpoint.  Thus,  R  will  generally  be 
different  at  each  gridpoint  in  the  analysis  area. 

The  analysis  that  results  from  this  .McIDAS  scheme  has  the  advantages  of  speed 
and  modest  core  requirements.  It  has  the  disadvantages  that  it  suppresses 


mesoscale  detail,  the  smallest  grid  resolution  that  can  be  selected  is  a  1 -degree 
latitude-longitude  grid,  and  the  largest  domain  that  can  be  analyzed  is  500  grid- 
points,  (25  gridpoints  east-west  and  20  gridpoints  north-south). 

An  alternative  objective-analysis  procedure  that  retains,  to  a  greater  extent, 
real  mesoscale  detail  over  a  broader  domain  and  with  greater  grid  resolution  was 

Q 

formulated  for  the  CYBER  170/750  along  the  lines  suggested  by  Koch  et  al  using 
the  Barnes  analysis  technique.  ^  It  is  a  computationally  simple  objective  proce¬ 
dure  that  uses  Gaussian  distance -weight  functions.  The  Barnes  weight  function 
(w  )  has  the  form 

wn  --  exp(-dn2/*o)  (8) 

where  d^  is  the  distance  between  the  observation  n  and  the  analysis  gridpoint,  and 
K  Q  is  a  shape  parameter  of  the  low-pass  filter  response  function.  This  analysis 
technique  can  achieve  good  agreement  between  observations  and  the  analyzed 
fields,  with  just  two  iterations  (or  correction  passes),  through  the  use  of  a  con¬ 
vergence  factor  y  (discussed  later)  that  controls  the  degree  of  agreement. 

In  our  application,  a  two-pass  correction  approach  was  used  to  adjust  the 
"first  guess"  analysis.  Typically,  an  individual  case  consisted  of  7  consecutive 
hours  of  surface  observations  needing  to  be  analyzed.  The  first-guess  for  the 
first  hour  of  each  case  was  assigned  from  the  mean  value  of  observations  within 
the  analysis  area;  for  hours  2-7,  the  final  analysis  of  the  previous  hour  was  used 
as  the  first  guess  for  the  next  hour. 

The  first  pass  analysis,  gj(i,  j),  obtained  by  correcting  the  first  guess  field 
at  each  gridpoint,  gQ(i,  j).  was  determined  from 

N  N 

gjU.j)  =  g0(i,j)  +  L  wn(<t>n-g  )/L  W  (9) 

n=l  ’  n=l 

where  <f>^  is  the  observation  and  gQ  the  corresponding  interpolated  value  from 

the  analysis  at  the  location  of  the  observation.  A  bilinear  interpolation  between 

the  gQ(i,  j)  values  at  the  four  gridpoints  surrounding  each  observation  point  (n) 

were  used  to  obtain  g  .  In  Eq.  (8),  a  value  of  36  was  assigned  to  k  based  on 
o#  n  o 

9.  Koch,  S.E.,  desJardins,  M. ,  and  Kocin,  P.  J.  (1983)  An  interactive  Barnes 

objective  map  analysis  scheme  for  use  with  satellite  and  conventional  data, 
J.  Climate  Appl.  Meteorol.  22;  1487-1503. 

10.  Barnes,  S.  L.  (1973)  Mesoscale  objective  analysis  using  we ighted  time-series 

observations,  NOAA  Tech,  Memo  ERI  NSSL-62.  National  Severe  Storms 
Laboratory,  Norman,  Okla.  (NTIS  COM-73-10781). 
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considerations  suggested  by  Koch  et  al.  Two  factors  are  considered:  the  spacing 
of  conventional  surface  data  in  the  eastern  United  States  and  the  analysis  grid 
resolution  of  0. 5-degree  latitude-longitude.  This  results  in  the  establishment  of 

a  cutoff  scan  radius  (R  )  of  12  grid  units  which  is  "sufficiently  large  that  the 
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filter  response  characteristics  remain  virtually  unaffected. " 

The  second  (final)  pass  analysis  g2(i.  j).  obtained  by  correcting  the  first  pass 
analysis  at  each  grid  point,  gj(i,  j),  was  determined  from 

N  N 

g2(i»3>  =  gi(i.j)  +  ^  <<£n  •§!„)/  ^  w*  (10) 

2  1  n=l  n  n  1,n  n=l  n 

where  w  *  is  the  weight  function  comprising  a  convergence  factor  (  Y )  which  can 
be  varied  to  control  the  degree  of  convergence  desired  in  the  final  analysis.  It  is 
computed  from 

w„  =  exp(-dn2/y*o)  (11) 

where  K  ,  in  our  application,  was  set  at  36.  Figure  7  illustrated  the  effect  of  y, 
which  can  be  set  at  any  value  of  1. 0  or  less,  on  the  shape  of  the  weight  function 
(w*)  depending  on  separation  distance  (d)  in  grid  units. 

Before  we  conducted  the  next  stage  of  forecast  experiments,  we  had  to  deter¬ 
mine  optimal  values  of  Y  for  each  surface  observation  element  to  be  analyzed. 

The  elements  included:  cloud  cover,  temperature,  u  and  v  wind  components, 
visibility,  and  ceiling  height.  In  addition,  we  had  to  decide  whether  to  analyze 
visibility  and  ceiling  height  in  natural  logarithmic  form  or  basic  units  because 
their  reported  values  can  range  over  three  orders  of  magnitude  within  one  analysis 
field.  That  variability  can  cause  numerical  instability  in  objective -analysis  pro¬ 
cedures. 

Hourly  observations  for  a  3 -day  period,  from  1200  GMT  5  December  1983 
through  1200  GMT  8  December  1983,  were  selected  as  a  test  sample.  This 
sample  comprised  a  period  of  active  systems  with  substantial  horizontal  gradients 
and  was  deemed  to  be  a  robust  test  of  the  analysis  technique.  Figure  8,  the  sur¬ 
face  weather  map  for  1200  GMT  6  December  1983,  illustrates  the  general  nature 
of  surface  weather  during  the  test  period.  The  analysis  area  is  denoted  by  the 
heavy  dashed  border.  It  contains  about  240  surface  observation  sites.  The  grid 
resolution  was  0.  5  degree  latitude-longitude. 

The  evaluations  were  conducted  along  two  lines:  using  root -mean- square 
(rms)  error  statistics  and  a  subjective  evaluation  of  mapped  fields.  Table  1  lists 
the  overall  rms  error  for  the  options  on  convergence  factor  (  Y )  and  element  form 
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Kigure  8.  Surface  Weather  Map  for  1200  UT,  6  December  1983 


Table  1.  Overall  Error  Statistics  for  Analysis  Test  Period 


Element 

(Units) 

Form 

y 

RMSE 

Cloud  Cover 

Basic 

.3 

.391 

(4  categories) 

.2 

.1 

.  361 
.298 

Temperature 

Basic 

.4 

1.  159 

(C  ) 

.3 

.2 

1.076 

.963 

u-comp 

Basic 

.4 

1.484 

(m/sec) 

.3 

.2 

L  421 
1.319 

v-comp 

Basic 

.4 

1.  574 

(m/sec 

.3 

.2 

1.503 

1.394 

Visibility 

Basic 

.3 

3.040 

(Miles) 

.2 
.  1 

2.793 

2.267 

(In  mi) 

Ln 

.3 

.547 

.2 

.  502 

.  1 

.405 

Ceiling 

Basic 

.3 

33.768 

(100  ft) 

.2 
.  1 

31.337 

26.008 

(In  100  ft) 

Ln 

.3 

.  655 

.2 

.600 

.  1 

.489 

(In  vs  basic)  that  were  tested.  Since  we  wanted  to  retain  mesoscale  detail,  we 
restricted  the  variation  on  y  between  0, 1  and  0. 4. 

We  used  all  the  observation  locations  that  contributed  to  the  analysis  at  each 
map  time  to  develop  the  rms  error  statistics.  That  is,  we  did  not  withhold  a 
certain  percentage  of  observations  from  the  analysis  to  use  as  independent  data 
for  verification  statistics.  It  is  not  surprising  then,  that  the  convergence  factors 
which  force  the  greatest  degree  of  fit  or  agreement  between  the  analysis  anu 
observations  yielded  the  lowest  error  statistics.  For  this  reason,  a  complemen¬ 
tary  subjective  assessment  of  the  objectively  analyzed  maps  was  undertaken  to 
examine  the  effect  of  reducing  the  convergence  factor  even  lower  (to  0. 1  for 
temperature,  u-component,  and  v-component,  and  to  0.  05  for  the  sensible  weather 
elements  of  cloud  cover,  visibility,  and  ceiling  height). 

Figures  9a,  9b  and  9c  show  a  manually  analyzed  visibility  map  (natural  log) 
for  6  December  1983,  1500  UT,  the  objective  analysis  with  V  =  0. 10,  and  the 
objective  analysis  with  f  =  0.05.  The  rms  errors  resulting  from  reducing  the 
second-pass  convergence  factor  to  0. 05  for  cloud  cover,  visibility,  and  ceiling 


Figure  9a.  Analysis  of  Surface  Visibility  (in  Log  Natural  Form)  for  1500  UT»  6  December  1983: 
Manual  (Subjective)  Analysis 


ure  9b.  Analysis  of  Surface  Visibility  (in  Log  Natural  Form)  for  1500  UT,  6  December  1983:  Barnes 
ilysis  With  7  =  0. 10 


Analysis  of  Surface  Visibility  (in  Log  Natural  Form)  for  1500  UT,  6  December  1983:  Barnes 


height,  and  to  0. 1  for  temperature  and  the  u,  v  wind  components  were  loze  r  than 
for  factors  of  0. 1  and  0.2  respectively.  However,  when  compared  (subjectively) 
to  the  manually  analyzed  maps,  there  was  better  agreement  with  maps  analyzed 
with  convergence  factors  of  0. 1  and  0. 2.  For  the  stronger  factors  (0.  05  and  0. 1), 
the  analyses  overspecified  map  extrema,  yielding  maximum /minimum  gridpoint 
values  beyond  the  corresponding  maximum /minimum  observation  values. 

Experiment  ICC,  the  next  step,  tested  the  modified  Bames-analysis  technique 
using  the  March  1983  data  base  and  the  advection  forecast  techniques.  The  primary 
goal  for  this  test  was  to  determine  the  improvement  in  forecast  skill  achieved  by 
using  the  Barnes  analysis  with  0.  5-degree  resolution  instead  of  the  McIDAS  1-de¬ 
gree  analyses.  An  improvement  would  be  expected  first  because  the  higher 
resolution  would  mean  an  ability  to  resolve  and  forecast  smaller  disturbances 
than  is  possible  with  a  1-degree  grid.  Also,  by  using  the  previous  analysis  as  a 
first  guess,  the  time  continuity  is  better  portrayed.  This  should  produce  better 
change-advection  forecasts  than  the  McIDAS  routine,  which  uses  a  constant  first 
guess  (usuaUy  a  zero  value)  for  each  map. 

In  setting  up  Experiment  ICC,  we  decided  to  use  the  same  McIDAS-generated 
upper-level  wind  analyses  as  in  Experiment  IIEB  for  the  advection  flow.  Also,  we 
used  the  same  modified  surface  weather  data.  However,  four  changes  were  made 
in  the  forecast  procedure.  First,  the  cloud  ceiling  height  was  included  as  a  fore¬ 
cast  parameter,  replacing  the  dewpoint  temperature.  Since  ceiling  height  often 
varies  over  about  three  orders  of  magnitude,  the  natural  logarithm  was  used  (the 
thresholds  for  ceiling  in  MOS  forecasts  are  nearly  logarithmic  in  distribution). 
Unfortunately,  ceiling  height  becomes  discontinuous  when  the  cloud  cover  decreases 
from  broken  to  scattered,  as  no  ceiling  is  defined  when  there  is  less  than  0.  6 
cloud  cover.  Since  total  cloud  cover  was  also  a  forecast  parameter,  a  procedure 
was  adopted  where  ceiling  forecasts  would  only  be  verified  when  the  sky  cover  was 
both  forecast  and  observed  to  be  broken  or  overcast.  For  analysis  purposes,  a 
dummy  value  equivalent  to  45,  000  ft  (about  14km)  was  entered  for  clear  or  scat¬ 
tered  cloud  conditions.  In  retrospect,  a  better  policy  might  have  been  to  enter  the 
height  of  the  highest  scattered  layer  (this  would  be  most  apt  to  become  the  "ceiling" 
if  sky  cover  increased).  Without  clouds,  a  condition  of  "missing"  (which  would  be 
ignored  by  the  analysis  procedure)  might  have  been  better. 

The  second  change  concerned  the  way  cloud  amount  was  analyzed.  In  the 
McUMS  software,  clear  sky  is  given  a  value  of  -5,  scattered  cloud  is  15,  broken 
cloud  is  25,  overcast  is  35,  and  precipitation  is  45.  The  rationale  was  to  have  the 
zero  isopleth  surround  the  clear  sky  and  the  30  isopleth  surround  the  overcast  sky 
area,  but  this  scheme  caused  some  difficulties  in  interpreting  and  verifying  the 
advection  forecasts.  By  the  time  Experiment  IIIB  was  run,  maximum  allowed 
forecasts  and  verification  was  set  to  35  (cloudy)  and  minima  at  -5  (clear).  Note 


that  change  advection  and  diurnal  modification  could  result  in  forecasts  exceeding 
the  limits. )  For  the  Barnes  analyses,  the  simpler  procedure  of  0  for  clear,  10 
for  scattered,  20  for  broken,  and  30  for  overcast  was  adopted. 

The  third  change  was  quite  minor.  When  the  visibility  is  reported  as  0  miles, 
a  natural  logarithm  cannot  be  computed.  In  previous  experiments,  0. 05  mile  was 
added  to  each  visibility  before  the  logarithm  was  computed.  In  Experiment  IIIC, 

0. 05  mile  was  entered  only  when  the  visibility  was  less  than  0. 10  mile. 

The  last  change  also  involved  the  visibility.  In  previous  experiments,  the 
McIDAS  software  made  objective  analyses  of  visibility,  advection  forecasts  were 
made,  and  then  (prior  to  verification)  the  forecast  values  (in  miles)  were  conver¬ 
ted  to  a  natural  logarithm.  Presumedly,  an  objective  analysis  would  better  depict 
patterns  of  low  visibility  if  the  conversion  to  logarithm  were  made  before  the 
analysis.  Thus,  for  Experiment  IIIC,  analyses  and  forecasts  were  based  on  the 
natural  logarithm  of  reported  visibility  values  and  the  natural  logarithm  of  ceil¬ 
ing  height. 

These  four  changes  were  introduced  in  the  advection  forecast  software, 
which  also  had  to  be  modified  to  accept  the  higher  resolution  grids  (four  times 
as  many  points).  Then,  the  12  forecast  cases  for  March  1983  were  run,  produ¬ 
cing  forecasts  out  to  15  hours  at  12  different  forecast  sites.  The  results  are 
shown  through  skill  score  vs  time  for  the  six  forecast  parameters  in  Figures 
10-15.  In  addition,  more  detailed  information  is  presented  in  Tables  A1-A12. 

Overall,  the  results  are  somewhat  disappointing.  Figures  10-15  compare 
scores  for  Experiment  IIIB  (thin  line)  with  Experiment  IIIC  (bold  line)  for 
700  mb  advection  (solid  line)  and  best  combination  (dashed  line).  For  cloud 
amount,  the  Experiment  IIIC  forecasts  are  clearly  better.  For  the  other  para¬ 
meters,  they  are,  if  anything,  slightly  worse,  particularly  for  time  periods 
beyond  about  4  hours.  To  better  compare  Experiments  IIIB  and  IIIC,  skill 
scores  based  on  1-4  hours  change-advection  (500  mb)  and  5-9  hour  advection 
(500 mb)  were  computed  and  are  presented  in  Table  2  (these  approximate  best 
combination  scores).  The  scores  are  also  stratified  by  time,  with  six  cases  (up 
to  72  forecasts)  for  0300  UT  forecasts  and  six  cases  for  1500  UT  forecasts.  The 
tine  breakout  was  made  to  note  any  difference  between  the  day  forecasts  and 
night  forecasts  since  about  15-20  percent  more  observations  were  available  in 
the  daytime.  In  this  table,  it  is  clear  that  the  cloud  amount  forecasts  are 
improved  for  both  day  and  night  forecasts  and  for  both  1-4  and  5-9-hour  fore¬ 
casts.  The  scores  for  change  advection  for  wind  are  essentially  the  same,  but 
the  IIIC  advection  scores  for  5-9  hours  are  slightly  worse,  both  day  and  night. 

The  1 -4-hour  change-advection  forecasts  for  visibility  are  a  little  improved  at 
night  and  worse  by  day,  and  the  5-9-hour  advection  forecasts  are  worse  at  both 
times.  The  1 -4-hour  change-advection  temperature  forecasts  are  also  a  little 
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Figure  11.  Forecast  Skill  Scores  (Relative  to  Persistence)  for  Experiments  RIB  and  HIC:  Vector  Wind 


Forecast  Skill  Scores  (Relative  to  Persistence)  for  Experiments  HIB  and  mC:  Wind  Speed 


LN  VISIBILITY 


Forecast  Skill  Scores  (Relative  to  Persistence)  for  Experiments  MB  and  MC:  Visibility 


1-4  h  Change -Ad vectlon  Forecasts  (500  mb) 


0300  UT 

1500  UT 

IIIB 

me 

IIIB 

me 

Parameter 

Pers. 

Fc  st 

Pers. 

Fcst 

Pers. 

Fcst 

Pers. 

Fcst 

Cloud  Amount 

(  .67) 

-.01 

(  .67) 

+.04 

(  .54) 

-.54 

(  .54) 

-.13 

Vector  Wind 

(2.55) 

+.  14 

(2.55) 

+.  14 

(3.  16) 

+.01 

(3.16) 

+.01 

Wind  Speed 

(1.55) 

-.01 

(1.55) 

-.01 

(1.  56) 

-.09 

ft.  56) 

-.12 

Ln  Visbibility 

(  .38) 

-.02 

(  .39) 

+.00 

(  .60) 

-.03 

(  .62) 

-.18 

Ln  Ceiling 

-- 

— 

(  .55) 

-.  17 

— 

-- 

(  .69) 

-.28 

Dew  Point 

(1.90) 

+.  12 

-- 

-- 

(1.33) 

-.  50 

— 

— 

Temperature 

(1.74) 

-.01 

(1.74) 

+.  17 

(2.84) 

+.  38 

(2.84) 

+.  39 

5- 

9  h  Advection  Forecasts  (500  mb) 

0300  UT 

1500  UT 

IIIB 

IIIC 

IIIB 

HIC 

Parameter 

Pers. 

Fcst 

Pers. 

Fcst 

Pers. 

Fcst 

Pers. 

Fcst 

Cloud  Amount 

(1.06) 

+.21 

(1.06) 

+.39 

1  .79) 

-.  19 

(  .  79( 

-.06 

Vector  Wind 

(4. 12) 

+.21 

(4. 12) 

+.  17 

(4.42) 

+.21 

(4.42) 

+.  19 

Wind  Speed 

(2. 17) 

+.  12 

(2. 17) 

+.11 

(2.  12) 

-.06 

(2.12) 

-.06 

Ln  Visibility 

(  .74) 

+.08 

(  .77) 

+.02 

(  .84) 

+.  14 

(  .86) 

-.  02 

Ln  Ceiling 

— 

— 

(  .84) 

-.09 

— 

— 

(1.01) 

-.  07 

Dew  Point 

(3.27) 

+  .25 

— 

(2.40) 

+.  10 

— 

Temperature 

(2.98) 

-.13 

(2.98) 

-.22 

(3.74) 

-.38 

(3.  . 

-.39 

better  at  night,  unchanged  in  the  day.  and  the  5-9-hour  advection  forecasts  worse 
at  both  times. 

When  the  forecasts  using  the  0.5 -degree  Barnes  analyses  did  not  produce 
improved  forecasts,  there  was  concern  that  the  routines  did  not  perform  properly 
on  the  independent  data.  For  a  little  more  insight,  computations  were  made  for 
the  spatial  variability  and  analysis  errors  of  the  two  experiments,  with  the 
results  shown  in  Table  3.  The  first  two  columns  show  that,  for  wind  and  tempera¬ 
ture,  the  higher  resolution  analyses  have  noticeably  higher  spatial  variability, 
as  would  be  expected.  For  cloud  amount,  the  situation  is  reversed,  but  this  is 
almost  certainly  because  the  range  in  Experiment  IIIB  is  -5  to  45  and  only  0  to  30 
in  Experiment  I1IC.  The  visibility  analyses  cannot  be  directly  compared  because 
Experiment  IIIB  is  in  miles,  while  Experiment  IIIF  is  rms  of  the  logarithm.  The 
analysis  errors  of  the  next  two  columns  are  based  on  the  0-h  forecast  errors  at 
the  12  forecast  locations.  Except  for  the  cloud  amount,  the  Experiment  IIIC 
analyses  seem  to  be  slightly  worse  (about  2  percent),  but  the  difference  is  negli¬ 
gible.  ,  The  Barnes  analysis  software  provides  rms  analysis  errors  for  all  stations 
used  (typically  330-380  stations),  and  in  the  next  column,  these  values  are  seen  to 


Table  3.  Spatial  Variability  and  Analysis  Errors  for  1 -Degree  McIDAS 
Analyses  (IIIB)  and  0.5-Degree  Barnes  Analyses  (IIIC) 


RMS  Variability 

I 

rsis  Errors 

12  Stations 

All  Sta. 

Devel. 

Parameter 

IIIB 

IIIC 

IIIB 

IIIC 

IIIC 

IIIC 

Cloud  Amount  (cat) 

1.32 

0.98 

0.  56 

0.31 

0.32 

0.30 

U-component  (mps) 

2.79 

3.27 

— 

-- 

1.04 

1.32 

V-component  (mps) 

2.  59 

3.65 

-- 

— 

1.09 

1.39 

Vector  Wind  (mps) 

3.80 

4.  90 

1.97 

2.01 

1.  50 

1.85 

Ln  Visibility 

4.39' 

0.  99 

0.39 

0.40 

0.  40 

0.  40 

Ln  Ceiling 

-- 

1.  57 

— 

0.  44 

0.48 

0.44 

Dewpoint  (C) 

5.  65 

6.  16 

0.  94 

0.  96 

0.  94 

0.  96 

Temperature  (C) 

5.89 

Abased  on  visibility  in  miles. 

not  natural  logarithm. 

be  quite  similar  to  those  based  on  only  12  forecast  stations.  The  final  column 
indicates  the  rms  errors  for  the  dependent  December  analysis  tests,  and  these 
values  are  quite  consistent  with  the  others.  As  a  final  test,  the  rms  analysis 
errors  for  each  forecast  case  and  each  parameter  are  shown  in  Figure  16.  From 
this  figure,  the  analyses  appear  to  be  stable  and  consistent  in  quality  from  case 
to  case  and  there  seems  to  be  no  indication  that  the  analysis  procedure  did  not 
perform  as  well  on  the  independent  March  1983  data  as  it  did  on  the  dependent 
December  1983  data. 

These  results  indicate  that  the  new  analysis  routine  did  produce  what 
appeared  to  be  better  mesoscale  analyses.  The  finer  scale  analyses  were  better 
defined  and  there  was  better  temporal  continuity.  There  are  several  possible 
explanations  of  why  the  "improved"  analyses  did  not  lead  to  improved  advection 
forecasts.  First,  the  smallest -scale  disturbances  maybe  largely  orographic 
(stationary)  in  nature.  Further,  these  disturbances  may  have  too  short  a  life¬ 
time  to  be  successfully  forecast  by  advection.  There  is  also  a  possibility  that 
the  bilinear  interpolation  scheme  used  in  the  forecast  procedure  may  be  too  coarse 
to  capture  all  available  information.  Higher  order  interpolation  might  be  better. 

5.  DISCISSION 

When  this  program  of  advection-forecast-technique  development  began,  the 
basic  premise  was  that  traveling  mesoscale  disturbances  were  a  major  cause  of 
short -period  changes  in  surface  weather  conditions.  Some  modest  success  has 
been  achieved  through  tests  of  various  advection  flows,  through  development  of 
change-advection  procedures,  and  other  enhancements  to  the  advection  technique. 

A  summary  of  qualitative  results  is  shown  in  Table  4,  which  indicates  the  gain 
(or  loss)  in  skill  that  resulted  from  the  introduction  of  various  modifications. 

Obviously,  not  all  attempts  at  improvement  were  successful,  but  overall, 
there  has  been  encouraging  progress.  At  the  present  time,  the  best  advection 
techniques  show  skill  better  than  both  MOS  and  persistence  for  periods  out  to 
about  6  hours  for  cloud  cover,  vector  wind,  and  visibility.  These  results  do 
indicate  that  information  from  the  hourly  aviation  weather  network  can  be  used  to 
improve  forecasts  objectively  through  the  use  of  modified  forms  of  advection. 

While  we  have  been  encouraged  by  the  steady  improvement  in  forecast  skill 
scores  through  enhancement  of  the  advection  technique,  the  levels  of  skill,  with 
values  like  +0.05  to  +0.20,  might  appear  low.  An  important  question  is  how  high 
must  the  skill  level  be  before  the  technique  can  be  considered  useful.  The  first 
point  to  consider  is  that  these  skill  scores  are  based  on  rms  errors,  and  a  more 
realistic  measure  is  the  "variance. "  A  skill  score  of  +0. 30  means  that  about 


Figure  16.  Variation  of  Root-Mean-Square  (RMS)  Analysis  Error  for 
Cases  Comprising  the  March  1983  Independent  Data  Set 


38 


Table  4.  Results  of  Forecast  Experiments  II  Through  IIIC:  Changes  Rela 
tive  to  Simple  700-mb  Advection 


1 — . .  ■  . -1 

Better  Forecasts 

Worse  Forecasts 

Change -advection  (0-3  hours) 

Change-advection  (5-15  hours) 

700-500  mb  space -averaged  flow 

850-300 mb  vertically  integrated  flow 

500  mb  space-averaged  flow 

850  mb  flow,  double  advection 

850  mb  flow  (double  advection) 

(temperature  and  dewpoint) 

(clouds,  visibility,  winds) 

Modification  for  diurnal  changes 

Adjustment  of  initial  data 

(winds,  dewpoint) 

0.  5-degree  Barnes-type  analyses 

0.  5-degree  Bames-type  analyses 

(clouds,  temperature  using 
change  advection) 

(wind,  visibility) 

50  Dercent  of  the  temporal  change  variance  (analogous  to  spectral  "power")  has 
been  correctly  forecast.  And.  a  skill  score  of  +0.20  means  36  percent  of  the 
variance  correctly  forecast.  From  this  point  of  view.  +0.2  might  mean  an 
important  part  of  the  variance  correctly  forecast,  and  +0. 3  might  mean  a 
majority  forecast  correctly. 

An  interactive  forecast  experiment  was  recently  completed  at  AFGL*1 
when  a  number  of  forecast  aids  were  evaluated  to  determine  usefulness  to  the 
forecaster.  The  MOS  forecasts  were  the  primary  objective  guidance  for  the 
vector  wind,  and  the  5-10-h  forecasts  were  about  30  percent  better  than  persis¬ 
tence.  The  forecasters  considered  this  guidance  for  wind  useful  67  percent  of 
the  time.  By  contrast,  the  ceiling  and  cloud -amount  category  forecasts  for 
MOS  were  only  5-10  percent  better  than  persistence,  and  this  guidance  was  use¬ 
ful  only  53  and  58  percent  of  the  time.  Considering  the  variance  correctly  fore¬ 
cast  and  also  the  forecast  aid  evaluation,  we  can  suggest  that  objective  guidance 
should  begin  to  be  useful  when  skill  scores  reach  +0. 15  to  +0.20  and  be 


11.  Chisholm,  D.A.,  and  Jackson,  A.J.  (1984)  An  Assessment  of  Interactive 
Graphics  Processing  in  Short-Range  Terminal  Weather  Forecasting. 
AFGL-Tti-64-0029,  AD  A142706. 


definitely  useful  when  they  reach  +0. 30.  After  some  effort,  the  scores  for  some 
parameters  and  some  time  periods  are  reaching  these  levels.  Some  questions 
to  consider  are:  "Realistically,  how  much  more  improvement  can  we  expect?" 
and  "How  should  we  best  design  future  improvements?" 

To  begin  to  answer  these  questions,  we  should  start  by  considering  a  basic 
forecast  limitation  due  to  the  variability  that  cannot  be  resolved  by  analysis  grids. 
Let  us  say  there  is  a  prediction  Qf  and  that  Oq  is  observed.  Further,  that  Qq 


is  composed  of  Qg,  the  grid -scale  value,  and  Qg  is  the  subgrid  scale  disturbance. 


The  rms  forecast  error  F  is  computed  by: 

1/2 


•  [  -  °g  -  V  1 


(12) 


where  the 


represents  an  average  over  many  stations  and  many  cases.  The 


best  we  can  hope  for  is  that  the  advection  technique  will  perfectly  forecast 
Qg  (Qf  =  Qg),  leaving  some  error  due  to  subgrid  scale  variability.  If  P  is  the 


rms  persistence  error,  the  skill  score  S  is 


S  = 


P  -  F 


-  1  -  —  . 
P 


(13 


The  maximum  possible  skill  score  will  be  Sx,  given  by 

_  1/2 

Sx  .  .  -  .  (H 

P 

Assuming  the  rms  analysis  errors  Vg  represent  subgrid  scale  forecast 
errors,  then  we  can  use  computed  values  of  rms  persistence  errors  to  solve 
Eq.  14  for  the  maximum  skill  score.  Calculations  were  made  for  seven  para¬ 
meters  at  3  and  6  hours,  and  the  results  are  presented  in  Table  5.  Also  included 
in  this  table  are  values  of  the  best -combination  advection  forecast  scores.  Exam¬ 
ining  the  table,  we  see  that  the  weather  parameters  in  the  table  fall  into  two 
distinct  groups.  For  cloud  cover,  vector  wind,  temperature,  and  dewpoint,  the 
advection  skill  scores  Sg  are  all  positive,  generally  about  one-fourth  to  one-third 
the  maximum  skill  score  values.  At  that  point,  the  advection  guidance  forecasts 
would  reach  the  "useful"  level.  To  go  much  further,  one  would  have  to  find 
means  to  accurately  predict  development  and  decay  of  the  disturbances  as  well 
as  the  motion. 

On  the  other  hand,  developing  useful  advection  forecast  techniques  for  wind 
speed,  visibility,  and  ceiling  height  represents  a  somewhat  greater  challenge. 

For  these  parameters,  the  present  skill  scores  are  near  zero,  and  even  if 


Table  S.  Maximum  Skill  Scores  and  Best  Skill  Scores  for  3-  and  6-Hour 
Forecasts 


3  Hours  6  Hours 


m 

P2 

Sx3 

S  4 
&B 

P 

Sx 

Cloud  Cover  (cat. ) 

±0.31 

±0.65 

.52 

+.11 

±0.81 

.62 

+.20 

Vector  Wind  (mps) 

±1.81 

±3.  03 

.40 

+.11 

±4.02 

.55 

+.  19 

Wind  Speed  (mps) 

±1.27 

±1.63 

.22 

-.03 

±  1.96 

.35 

-.01 

Ln  Visibility 

±0.39 

±0.53 

.26 

+.  02 

±  0.73 

.47 

+.  14 

Ln  Ceiling 

±0.44 

±0.66 

.27 

-.  16 

±  0.87 

.45 

-.06 

Temperature  (C) 

±0.85 

±2.64 

00 

CD 

• 

+.33 

±  3.59 

.76 

+.27 

Dewpoint  (C) 

±  1. 12 

±1.77 

.37 

+.  05 

±  2.54 

.56 

+.14 

1.  Subgrid  variability  of  12  stations  (for  compatibility  with  persistence. 


unmodified  data  of  Experiment  IHA  used) 

V 

s 


- 2  1/2 

> 


2.  RMS  persistence  errors  at  12  stations  IT"  1/2 

(Q  ) 

3.  Maximum  skill  score  Sx  =  1  -  V  /P  =  1  -  — 5 — 

s  p 

4.  Best  advection  skill  score 


suggested  improvements  raised  the  levels  to  one-half  the  maximum  level,  the 
forecasts  still  would  not  be  very  useful,  especially  for  periods  less  than  6  hours. 
Thus,  the  first  step  would  be  to  produce  higher  resolution  analyses  and  nonlinear 
interpolation  to  significantly  reduce  analysis  error.  In  addition,  satellite  and 
radar  information  would  be  needed  to  help  fill  in  detail  in  sparse  data  regions. 
Even  with  greatly  impproved  analyses,  improvements  in  the  forecast  may  not  be 
as  great  as  might  be  expected  because  the  recovered  small-scale  disturbances 
may  have  lifetimes  as  short  as  1-3  hours  or  less.  However,  wind  speed,  visi¬ 
bility,  and  ceiling  are  very  important  forecast  parameters  for  aviation,  and  small 
positive  skill  scores  would  probably  still  be  appreciated.  To  provide  maximum 
information  on  these  difficult  parameters,  it  may  be  desirable  to  convert  the 
advection  forecasts  from  absolute  values  to  probabilities.  In  the  long-run,  high- 
resolution  numerical  prediction  models  offer  the  most  hope  to  solve  the  short- 
range  forecast  problem  for  these  particularly  difficult  parameters. 
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Appendix 

Tables  of  Forecast  Scores  for 
Experiments  NIB  and  INC 


T  echniques 

Adv.  +  Diur. 
Change- A dvs. 
500 

700  mb 
5*7 


5*8 


Advection  with  modification  for  diurnal  changes 
Change  -A  dvection 

500 -mb  space -averaged  advection  flow 
700 -mb  advection  flow 

Double  advection;  500 -mb  space -average  flow  advecting 
700 -mb  advection  flow 

Double  advection;  500 -mb  space -average  flow  advecting 
8 50 -mb  advection  flow 
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XX. 


Table  A6.  Advection  Forecast  Experiment  II1B:  Skill  Scores  Relative  to  Persistence  (144  Forecasts) 
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Table  A7.  Advection  Forecast  Experiment  IIIC:  Skill  Scores  Relative  to  Persistence  (144  Forecasts) 
Total  Cloud  Cover 


Table  A8.  Advection  Forecast  Experiment  IIIC:  Skill  Scores  Relative  to  Persistence  (144  Forecasts) 
Vector  Wind 


VISIBILITY  (rms  errors  in  parentheses) 
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Advection  Forecast  Experiment  IIIC:  Skill  Scores  Relative  to  Persistence  (144  Forecasts) 


Table  A12.  Advection  Forecast  Experiment  IIIC:  Skill  Scores  Relative  to  Persistence  (144  Forecasts) 
Temperature 
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